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Abstract 

Possible entropy constraints on particle acceleration spectra are 
discussed. 

Solar flare models invoke a variety of initial distributions of 
the primary energy release over the particles of the flare plasma 
- ie., the partition of the energy between thermal and nonther- 
mal components. It is suggested that, while this partition can 
take any value as far as energy is concerned, the entropy of a 
particle distribution may provide a useful measure of the likeli- 
hood of its being produced for a prescribed total energy. 

The Gibbs' entropy is calculated for several nonthermal 
isotropic distribution functions /, for a single particle species, 
and compared with that of a Maxwellian, all distributions hav- 
ing the same total number and energy of particles. Specula- 
tions are made on the relevance of some of the results to the 
cosmic ray power-law spectrum, on their relation to the ob- 
served frequency distribution of nonthermal flare hard X-ray 
spectrum parameters and on the additional energy release re- 
quired to achieve lower entropy /s. 
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1 Introduction 

Models in which energetic particles are invoked as a major 
component of primary energy release in the impulsive phase 
of solar flares have been both popular and controversial for 
decades (see eg, reviews (Brown, 1991; Simnett, 1991)). De- 
spite ever improving data and theoretical modelling, however, 
it remains unresolved how important such particles are in flare 
energy transport. Brown and Smith (1980) suggested that 
the lower entropy of accelerated particles compared to a pure 



Maxwellian distribution might place a theoretical thermody- 
namic constraint on the fraction of magnet ic ene rgy release 
likely to go into such acceleration. Brown (1993) has raised 
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this issue again and illustrated the point with a simple example 
of the thermal/nonthermal entropy difference. 

In this paper we put this question on a more quantitative basis 
by examining the entropy of more general particle distribution 
functions. Essentially the idea is that, solely on energy con- 
servation grounds (first law of thermodynamics), deposition of 
energy E among N cold particles could equally well result in 
(for example) a Maxwellian of temperature 2E/3Nk, a sin- 
gle particle of energy E with the rest cold, or a delta function 
distribution of all the particles at particle energy E/N. In a 
statistical sense, however, it is obvious that the last two are 
much less probable than the first - ie., they have much lower 
entropy. (Evolution of a plasma distribution function / from 
a cold Maxwellian to a nonthermal form with high mean en- 
ergy does of course involve a particle entropy increase and so 
is not precluded by the second law of thermodynamics. How- 
ever, while not impossible such an outcome is statistically much 
less probable than production of a hot Maxwellian / since it 
has lower entropy). Quantifying how much lower the entropy 
(probability) is should help constrain, in a statistical sense, the 
likely forms of particle distributions produced by prescribed 
energy release conditions or conversely constrain the energy 
release conditions required to yield a prescribed particle distri- 
bution. 

We recognise at the outset that the present calculations are 
exploratory and rest on simplifying assumptions which need 
further study. In particular we assume that entropy considera- 
tions are relevant - this raises issues regarding equilibrium and 
closure of the system, for example, which have been addressed 
in broad terms by Tolman (1959 . pp. 560-564) - but we feel that 



this will be so provided we deal only with newly-accelerated 
particles outside the (presumably small) accelerating volume. 
Secondly, we compare here only the entropies of alternative 
forms of the particle distribution function which could be gen- 
erated by deposition of energy E among N particles in a pre- 
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scribed volume V. We neglect, for the moment, entropy con- 
tributions from other system degrees of freedom and, in partic- 
ular, from plasma waves, and from the changing magnetic field 
presumed responsible for generating the flare particle distribu- 
tion. The possible importance of including plasma waves as 
additional degrees of freedom in considering the evaluation of 
pla sma entropy durin g particle acceleration has been discussed 
in ( 3rognard, 1983 ). Our neglect of magnetic field entropy 
is based on the heuristic argument that the field is associated 
solely with an ordered zero entropy flow component of the par- 
ticles - the Gibbs entropy JJJflnf d^v of any particle dis- 
tribution function / (v) is unchanged by adding a systematic 
drift vq (ie., v ^ v + vo). 

2 Definitions 

In this paper we will deal solely with the Gibbs entropy S of the 
3-D (velocity space) distribution function /(r,v) for a single 
species of nonrelativistic particle of mass to, defined by 



S^-k / /In/d-Vd^v 



(1) 



where k is Boltzmann's constant. For simplicity, we consider 
only distributions in which the velocity v distribution is sep- 
arable from the configuration space r dependence. With this 
restriction, we may write 

/(r,v) =n(r)G(v) (2) 

where n(r) is the total particle space density at r and 

f G(v)d3v = 1 (3) 

J V 

Because (|l]) is not linear in /, the absolute value of S de- 
pends on the velocity and coordinate units used. Here, however, 
we will only be concerned with entropy differences between 
different G(v). If we take some characteristic speed vq as ve- 
locity unit and write v = vqU and G(v) — > g{u)/vQ then ([l|) 
and (|) yield 

S = -k j ( n{r)g{u)\n[n{Y)g{u)/vl]d^vA^VL 
^ -k n(r)lnn(r)d^r / .g(u)d^u 

J r •/ u 

-k /n(r)d^r / ^(u) ln,g(u) d^u 

^ u 

+ klnvl / n(r)d^r / g(u)d^u 

J r -/ u 



-kNo /'g(u)ln.g(u)d3u 

J u 



+ kNo <j In - / n{r) In n{r) d^r )■ (4) 



where 



No^ n{r) d^r 



(5) 



is the total number of particles. If we consider different distri- 
bution functions / with the same spatial distribution n{r) and 
total volume (ie., same Nq) and use the same velocity unit vq 
throughout then we can measure the entropy differences by the 
'scaled entropy' 
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kNn 



s- 



fciVo I In -Wq - / n(r) Inn(r) d^r 



(6) 

so that by E can be expressed solely in terms of ^(u), via 
S{5} = - /.9(u)ln5(u)d3u (7) 

J U 

and we note, in terms of g, normalisation (S) is 



J u 



(8) 



We do not consider further here the spatial structure contri- 
bution to the entropy (last term in (^) - i.e., we only consider 
entropies of different g{u) but the same 7i(r).Also, throughout 
the rest of this paper we consider only isotropic /(v) so that 

d'^u ^ Attu^ du. We will be comparing the relative en- 
tropies of various distributions g with that of a pure Maxwellian 
of the same A^o and of the same total energy E (ie., we are com- 
paring identical plasmas with the same total energy deposited 
in them). It is therefore convenient to use as velocity unit vq, 
the thermal speed in the Maxwellian plasma 



vo = i2kTo/my/^ 



(9) 



where Tq = 2E/3Nok is the temperature of the plasma when 
all of E is deposited as heat in a pure Maxwellian. With 
this choice of vo and with g isotropic the normalisation con- 
dition (^ ensuring the same number of particles is that ^(u) 
should satisfy 

g{u)u'^du=^ (10) 



/o 47r 
while the constraint ensuring the same total energy becomes 



g{u)u'^ du 



Stt 



(11) 
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3 Scaled entropies of specific distribu- 
tion functions 

3.1 Pure Maxwellian gM{u) 

Expressed in terms of g, a pure Maxwellian satisfying con- 
straints @ and (jnl) is 



9m{u) 



r3/2 



(12) 



which, in integrates straightforwardly to give the scaled 
entropy 

Sm = ^(l + lnTT). (13) 

3.2 Maxwellian with bump in tail gBiriu) 

One of the forms of distribution function with an accelerated 
component is a Maxwellian with a 'bump in tail'. Here we 
consider only a simple case to allow analytic treatment, namely 
a bump in tail centred on speed ui, and of narrow width Au <C 
1 over which the bump contribution to 5 is a constant added 
to the Maxwellian component which describes the rest of the 
plasma (cf Brown (1993)). Because of energy constraint (pi]), 
the temperature of this Maxwellian component is reduced by a 
factor r < 1 relative to the pure Maxwellian of case 3. 1 , by the 
energy resident in the bump. If the fraction of the particles by 
number in the bump and in the Maxwellian are respectively (j) 
and (1 — 0) (to satisfy the number constraint (10)) then 



9bit{u) 



1 



(7rr)3/2 



inufAu 







u in Am 
otherwise 



(14) 



with 



(15) 

and we note that the condition < 3/20 has to be met 
since r > 0, equality holding when the Maxwellian compo- 
nent of (1 — 0)A'^o remains cold. 

Substituting ( pl| ) and (|l5|) in (^ and approximating the in- 
tegrals on the assumption that Am ^ 1 and (f) / (AttuIAu) ^ 
1 — (/)e~"i/'^/(7rT)^/^ (ie, the bump is locally 'large') we ob- 
tain for the scaled entropy 



-'BIT[ 



,ui,Au) = 
-(hln 



47ruf Am / ' 2 
ln(l - 



(1 



1 + In TT - 



In 1 - 



3.3 Pure power law gpL( 



u 



A commonly occurring form of accelerated particle spectrum in 
solar flares and elsewhere in astrophysics is the power law 
Such f{v) diverges unless flattened or truncated at small v, so 
we first consider a truncated pure power law comprising all the 
plasma particles and again with the same total energy as the 
pure Maxwellian 34 . With number constraint ([lo|), this has the 
form 

M < Ml 

«-3/m\-" (17) 

=- 1 11. > 77,1 

47rMf V^*!. 



gpL 



where the dimensionless low energy cut-off speed ui has to be 
related to a to satisfy total energy constraint (p4|), viz. 



Ui 



3 a 



2a-3 



1/2 



(18) 



and we note that a > 5 is required for finite total energy. 
We note that the relation between a and the spectral index 5 
normally used (in solar flare physics) to describe the non- 
relativistic particle flux spectrum differential in kinetic energy 
( [Brown, 197l"l ) is a = 2^ + 1. 

Substitution of ( p^ and ( p^ in (^ leads to the scaled entropy 



S-1 



iln 



277r^ jS - 2)3 
2 {S- lY 



(19) 



3.4 Maxwellian with a power law tail 

The conventional wisdom regarding the behaviour of the real 
distribution funtion for the bulk of the electrons in a solar flare 
is that it is roughly Maxwellian at low velocities (where colli- 
sions dominate) but of power law (or other nonthermal form) at 
high velocities (where mean free paths become long and run- 
away may occur). Such a particle model spectrum finds some 
support in recent inversions of high resolution bremsstrahlung 
hard x-ray spectra (Johns and Lin, 1992; Thompson et al., 



1992; Piana, 1994) though these inferences are ambiguous be- 
cause of the effects of noise (Craig and Brown, 1986) and of 
averaging over an inhomogeneous source (Brown, 1971). It 



is therefore instructive to consider such a distribution from the 
viewpoint of entropy. A convenient functional form which ex- 
hibits these asymptotic behaviours at low and high v, and which 
circumvents most of the analytic messiness associated with a 
piecewise description is f{v) ^ (1 + m^/mj)""/^ (Robinson, 
1993). 



3.3, and 



The high velocity spectral index is a, as in 
the temperature T defining the shape at small v is fixed by a 



(j^{3) and vi such that 



■mvt 



akT. Similarly to cases 3.2 and 3.3, 



a and vi have to be interrelated to satisfy constraints (10) 
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and (pi]), namely ui = vi/vq = y^(a^^"5)72. Taking these 
constraints into account, the resulting g{u) is 



7r(a — 5) 



3/2 



ri 



a — 5 



V2 



(20) 



where r(a;) is the gamma function. 

Substitution of ( pO[ ) in (^ gives, for this case (with a = 26- 
1 as in Sect. 3.3) 



^MPL 



In 



7^3/2(5 _2)3/2r(J-l)_ 

-(5+i)[V'(<5-l)-V('5 + ^)] (21) 



where the psi function is 



dx 



[Inr(x)]. 



(22) 



Figure 1 is in file figl.ps 



4 Entropy comparison of nonthermal 
distributions with a pure Maxwellian 

We now compare the entropies of nonthermal distributions 
(HI), ([l|), and ^ with that of the pure Maxwelhan ([l|). 

4.1 Bump-in- tail 



This case was already briefly discussed by Brown ( 1993 ). Its 
most important features are: 



1. As. 



0, the pure Maxwellian entropy (|13[) is recovered. 



2. For any cj), ui (ie, no matter how few particles are acceler- 
ated or to how low a speed), the relative entropy — oo 
as Am — > - ie, as a finite number of particles in f{u) is 
crowded into an arbitrarily narrow velocity range. Consid- 
ering the relative entropy as the negative of the log of the 
probability P, this quantifies the qualitative improbability 
statement in Sect. 1 concerning the relative improbability 
of nonthermal distributions. We note, however, that the 
divergence of E to — oo is an artefact of taking the ap- 
proximate continuum function expression (1) for entropy 
to a point where the smoothness assumption made breaks 
down (see Appendix). 

3. No matter how small the fraction (p of particles accelerated 
is, as u{ Ss/T — oo because the fraction of the 
total energy in fast particles ^ 1 at that point, which is 
arbitrarily improbable. The same remark as in 2 applies. 



Figure 1: Scaled entropy AS = Y^m — S, relative to the 
Maxwellian for (a) a pure truncated power law and (b) a 
Maxwellian with a power-law tail. 

4.2 Pure power law 

In figure |l]a, we show the quantity AI]pi((5) = S^v/ — SpL as 
a function of 5 for the pure power-law case. The key features 
of this curve are 

1. There is a minimum in ASpL which occurs ?A 5 — 5q = 
(3 + V7)/2 K. 2.82. This is the value of 5 at which a 
sharply truncated power law most closely approaches the 
entropy of the Maxwelhan. 

2. As (5 ^ oo, SpL — oo and AEp^ +oo. This is 
because as (5 ^ oo, more and more of the particles are 
concentrated at a single velocity ui = ■\/3/2 (by ([T8|)) 
and the distribution is more and more like a delta func- 
tion, with associated low probability (cf., |4.l[). The same 



limitation applies here as in point 2 of Sect. 1 



3. As (5 ^ 2, AEpL — > +00 logarithmically. This is be- 
cause the distribution function then becomes very flat and 
wide with a decreasing probability of the increasing num- 
ber of particles needed at u ^ oo to satisfy the total en- 
ergy constraint (pi]). 

Another way to express the entropy comparison between qm 
and gpL is to consider the temperature Tg (or total energy) 
which a pure Maxwellian would need to have in order to have 
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as low an entropy as qpl with the same total number Nq of 
particles. The generalisation of (|l2|) to a Maxwellian of tem- 
perature r = T/Tb is gM{u^T) = exp(— u^/T)/(7rr)'^/^ and 
of (|13]) is 

SM(r) = i[l + ln(7rr)]. (23) 

Equating ( ^3| ) with (|l9|) we can find the dimensionless tem- 
perature t{5) = Tg /Tq required for the Maxwellian entropy to 
be as low as the power law, viz. In Tp^ = 2[I]pi — S^v/l/S, or 



In rpL ((5) 



In 



5-2 



(27r)i/3 (5-1)5/3 



(24) 



which also has a maximum at the value of 5 ^ 5q. 

The above results allow some quantitative interpretation, al- 
beit somewhat speculative. First, if we consider transient en- 
ergy release events, then the entropies of distribution functions 
of different 5 should be measures of the relative probabilities of 
these (5s being realised ;/ all the energy went into a pure power- 
law. In a large set of such events these should reflect in some 
way the relative frequency of occurrence of different (5s. In par- 
ticular, values of 6 near 6q, where Ep^ has a maximum, should 
be commonest (This is certainly not the case in the observed 
frequency distribution of flare 5 values inferred from hard X- 
ray bursts, but nor are flare spectra those of pure power laws 
with no Maxwellian component! - cf. Sect. 4.3 ). 



Second, we note that the above power-law entropy analysis 
also applies to the relativistic regime when v is replaced by the 
momemtum p and the maximum entropy power-law spectrum 
again has index (5o. This (5o is very close to the observed mean 
spectral index of cosmic ray particles over a very wide energy 



range (Longair, 1981) - a fact pointed out to us by Bell (1994) 



That is, if an unspecified mechanism operates to force a power- 
law form on the distribution function, under conditions of con- 
stant total particle number and energy, then the highest entropy 
(most likely) state is that with a power-law index close to the 
observed cosmic-ray one. This fact should be explored further. 

4.3 Maxwellian with power-law tail 

In figure [l|b we show the variation with 5 of AEmpl(^) = 
Yjm — '^ MPL (equivalent to ts) for this case, defined similarly 
to those in |4.2| , based on equations (|l3|) and (|l]), viz. 



AS 



MPL 



- + In 



((5-2)3/2r(,5-l). 
f i)[^(,5-l)-VX(5+i)](25) 

(26) 



In this case, which is expected to be much closer to the solar 
flare situation than the pure power law, there is no extremum 



in ATiMPL which tends to +oo as (5 ^ 2 and falls as i5 in- 
creases. This is essentially because, for a prescribed total Nq 
and E, the steep power law tail more and more closely resem- 
bles the Maxwellian for large 6. On the other hand as 6 de- 
creases, the entropy becomes smaller and smaller as deviation 
from the Maxwellian increases. If this result is interpreted sta- 
tistically in terms of the relative likelihood of a tail of given 6 
occurring, as compared to pure heating, it means that smaller 
and smaller S should occur less and less frequently. 

Observational inference of S in solar flares is achieved 
from the spectral index 7 of bremsstrahlung hard X-rays (eg. 



Brown (1971 )). In terms of the electron acceleration spectrum 
the event integrated 7 is related to (5 by (5 = 7 + 1 (for collision 
dominated thick target energy losses) and by (5 = 7—1 for col- 
lisionally thin targets. Kane (1974) has reported the statistics 



of observed occurrence of different 7 values. The qualitative 
trend of these data is similar to that predicted from the above 
entropy argument - ie, a sharp decline of numbers of events of 
small spectral index and a frequency distribution flattening off 
at larger indices (though the data are instrumentally limited to 
indices 7 < 6). 

In view of the simplications made in the present theoretical 
analysis (homogeneous source volume, neglect of waves and of 
anisotropy) the trend of the theoretical and observed distribu- 
tions is remarkably similar, and worthy of further investigation. 

5 Conclusions 

The lower entropy of a hot plasma with an accelerated com- 
ponent, as compared to a pure Maxwellian of the same total 
particle number and energy, quantifies the extent to which the 
hardest non-thermal components are further from equilibrium 
and so should occur less frequently. Calculation of the entropy 
difference in the case of a Maxwellian with a power-law tail 
of index 6 leads to a predicted frequency distribution of spec- 
tral indices in qualitative agreement with the general trend of 
the distribution inferred from the statistics of flare hard X-ray 
bursts. 

All distributions except the Maxwellian are non-equilibrium 
ones, which means that we cannot define a temperature for 
them and so, in turn, that we cannot use our expression for the 
entropies of these distributions in any non-trivial purely ther- 
modynamical argument. We can, however, make a cautious 
statistical argument, as we have done in Sects. 4.2 and n3, to 



the extent that, given a process which produces a certain non- 
thermal particle distribution, we expect some characteristics of 
that distribution to be more likely than others. We have no 
doubt that there are more, and more detailed, arguments to be 
made using these results. 
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The close coincidence of the observed cosmic-ray spectral 
index with that of a maximum entropy pure power-law is like- 
wise tantalising. 
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Appendix: the limitations of Eq. ([7|) 



As pointed out in Sect. |4.1| , the divergence of the 'scaled en- 
tropy' S to —oo is an artefact of the approximations made in 
deriving (jl]). To make this clear, we present here a brief deriva- 
tion of (Q) which concentrates on the steps before Eq. (|l]) rather 
than, as in Sect. |[ on the physics behind the definition of S. 
As above, we can write (S) 



/(r, 



n(r)G(v), 



where n(r) and G(v) are position and velocity distribution 
functions, respectively. Since these are independent, the statis- 
tical weight for the distribution /(r, v) - the number of ways 
of realising it - is simply — r2[7i(r)] x ri[G(v)], so 

that the entropy of the distribution /(n, v) will be the sum of 
the entropies in position and velocity spaces separately; this 
means that we can immediately ignore the constant contribu- 
tion of n(r) to the entropy, and instead concentrate on the en- 
tropy of the velocity distribution alone. In these terms, this is 



S[G] = k\nn[G], 



(27) 



where k is Boltzmann's constant, and Vl\G] is the statistical 
weight of the distribution, or the number of ways in which the 
distribution can be realised. Note that, since 51 [G] is a positive 
integer, the entropy S[G\ has a minimum of zero (which occurs 
when G(v) is a delta function - there is only one way of giving 
all the particles the same velocity). 

First define a dimensionless 'velocity' u = v/uq, for some 
arbitrary speed vq. Imagine dividing the accessible volume of 
velocity space into a finite number v of small, but not infinites- 
imal, volumes, size S'^u, at U;, so that there will be Ni = 



G{ui)5^\i particles in the volume centred on u^. Conse- 
quently, the total number of ways of distributing the N particles 
amongst the cells will be the multinomial Vl ~ Ili ^i'- 
we take 5^u to be large enough that each of the Ni is large, 
then we can approximate In Vl using Stirling's formula In A^! « 
iV In iV - A^, to obtain 



Inflw -iV^.g(Uj)lng(ui)(5^u. 

i 

where we have used the normalisation 



(28) 



(29) 



and then used the largeness of G(ui)(5^u to ignore In S'^vl, com- 
pared with InG(ui), before substituting G(u) = Ng{u.). If, 
finally, the scale d^u is small enough that we can take the dis- 
tribution function g{u) to be constant over it, then we can ap- 
proximate this final estimate for the distribution function ( 28 ) 
by an integral, and write the entropy (E7h as 



E[g] EE S[g]/Nk 



y".g(u)lng(u)d3u, (30) 



where we have replaced the approximation sign by an equality. 
Compare (Q). Crucially, the validity of the approximation (30) 
depends on the distribution function G(u) being such that there 
can be in fact a scale 5^u which simultaneously has sufficiently 
large Ni and sufficiently constant g{u.). If this is not so, we 
generate the artefacts described in Sects, i.l and 4.2 . 
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